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ARTICLE INFO ABSTRACT 

The aim of this research is to determine the emotions of the students 
who need special education during the teaching process through Tablet. 
Document analysis method was used to determine the emotions of the 
students who need of special education in the process of teaching through 
tablet. Five years old, three mentally retarded students were involved in the 
process of using the software. In the study, descriptive analysis method of 
Strauss & Corbin was used for the analysis of data obtained through interviews 
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1. INTRODUCTION 


There is an opinion that advanced learn- 
ing technologies can optimize the delicate 
balance between emotion and learning of aca- 
demic knowledge. Students are unlikely to be 
able to say or enjoy having an intense new 
jargon row, complex systems with many com- 
ponents, mental models exchanged between 
variables, solutions to difficult problems, and 
other difficult academic content. Technology 
should be designed according to models that 
allow students to experience emotional satis- 
fying experiences while trying to investigate 
the boring, over-compulsive or seemingly use- 
less subject. In an ideal world, technology will 
bring students right into the most appropriate 
concentration environment that targets the rel- 
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evant knowledge. 

As learners learn difficult academic con- 
tent, they have a wide range of technology that 
includes a commitment to coordinating their 
emotions and knowledge. Below is a summary 
of some of the technological approaches that 
have led to in-depth learning of the student 
(Graesser and D’Mello, 2014): 

- Create a flow situation (or intense par- 
ticipation) to the point where you are tired and 
lost in time. This can be accomplished by a 
simulation or play that presents knowledge, 
tasks and scenarios to the student’s most ap- 
propriate challenge area. This is not very easy 
or very difficult, but it is obvious that it is cor- 
rect. 

- Make an impressive storytelling that 
will continue to be of interest and consistency. 
The expression you make will integrate with 
the academic subject and increase its value. 

- If the student is not interested in the 
topic, reward him / her with the points / sourc- 
es that intensify or enrich the experience. 

- Have the interaction checked to ensure 
effective student, autonomy and self-control. 

- Give materials that can achieve suc- 
cess to build self-confidence and self-efficacy. 

- Collaborate step-by-step with the stu- 
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dent to improve interactivity and social readi- 
ness. 

- Give the students feedback on time to 
see what they have learned more clearly. 

- Give feedback and guidance about the 
student’s feelings to follow the coordination 
between feelings and learning. A student who 
is discouraged and demotivated can some- 
times think that teaching material is confus- 
ing, annoying, or boring. 

The designers of some learning environ- 
ments have deliberately thought about emo- 
tions of students while creating intelligent 
textbooks that are sensitive to effects, and 
serious games. It is important to know about 
emotions that students experience and how 
they are related to learning since sometimes 
emotions help learning but sometimes they af- 
fect the learning negatively. 

The instant emotions are intuitively 
open during learning process. For example, 
high motivated students insist on completing 
the tasks and having positive feelings when 
tasks are successfully completed. They are cu- 
rios when they are interested in the topic. They 
feel happiness when they make an invention 
and do not care about their fatiques. However, 
there are sometimes oppositional tendencies. 
When students face with various obstacles 
such as comprehension, production, reasoning 
and problem solving, frustration, irritation and 
other negative emotions, they feel disappoint- 
ment and negative emotions. They can also 
get bored when they encountered with small 
amounts of barrier as well as intensive techni- 
cal content (Graesser and D’Mello, 2014). 

Researchers have used a variety of 
methods to measure the immediate feelings 
students in technology-based learning en- 
vironments. (Calvo and D’Mello, 2010; Du 
Boulay et. al., 2011; D’Mello and Graesser, 
2010, D’Mello, Picard and Graesser, 2007; 
Picard, 2010; Woolf et. al, 2009). 

One of the most used methods to ob- 
serve the emotions is the observation made by 
educated observers. Educated observers peri- 
odically classify or rate the learners’ feelings 
during the learning session. (Baker, D’Mello, 
Rodrigo, Graesser, 2010; Craig, Graesser, 
Sullins, Gholson, 2004). Observers can have 
a checklist (eg, happy, sad, confused, etc.) or 
scoring scales with separate categories for the 
dimensions of feelings or categories. Observ- 
ers tend to focus on identifying emotions be- 
fore deciding not on the emotions that students 
experience during the process of interacting 
with technology. 

Emotion 


analysis, | computational 


thought evaluation in text are related to emo- 
tion and subjectivity. With emotional analy- 
sis, it is aimed to determine the opinion of a 
speaker or author according to a certain sub- 
ject or target. Opinion can express the au- 
thor’s thoughts, ideas or appraisal, emotional 
state or intended emotional communication. 
(Grafsgaard, Boyer, Phillips, Lester, 2011). 
Emotion analysis studies use approaches 
such as natural language processing, machine 
learning, computational linguistics and sym- 
bolic techniques. Makine 6grenmesi, verilen 
bir problemi ortamdan edindigi bilgiye gére 
modelleyen It is a subdivision of Artificial In- 
telligence discipline. Recently, besides textual 
emotional analysis, it has become possible to 
reveal emotional analysis in visual sense. To 
reveal it, there are different artificial intelli- 
gence applications or programs. One of the is 
microsoft emotion detection api. 

The emotion detection API, which is an 
API developed by Microsoft, which recog- 
nizes the emotions by analyzing the faces of 
the people in the photographs, serves the us- 
ers with the help of a website. By using this 
website, you can analyze the feelings of the 
people in the photos that you upload. There 
are feelings of anger, disgust, fear, happiness, 
neutral, sadness, confusion and hate as identi- 
fiable emotions in the uploaded photographs. 

The feelings of this service implement- 
ed by Microsoft is very different from the six 
“basic” emotions that easily emerge in the fa- 
cial expressions searched by Ekman (1992). 
These are sadness, happiness, anger, fear, 
disgust and surprise. It is also different from 
Pekrun’s longer-term emotions in academic, 
class, and social contexts, such as classifying 
academic feelings as epistemic, achievement, 
subject, and social feelings. (Pekrun, 2006; 
Pekrun, Elliot, Maier, 2006). 

Assistive technologies provide a great 
advantage to overcome the learning problems 
of mentally retarded individuals. (Alnahdi, 
2014; Kuzu at al., 2014). The use of visual and 
audiovisual tools and materials in the learn- 
ing-teaching process enriches the learning en- 
vironment and ensures is more permanent and 
more meaningful learning for the students. 
(Yanpar, 2008). Therefore, if the more kinds 
of different materials are used in the education 
of mentally handicapped individuals, and the 
more numerous sensory organs are addressed 
for the better learning and the persistence of 
knowledge (Soykan and Ozdamli, 2016). 

While the use of educational technol- 
ogy have great importance in the education 
of mentally handicapped individuals, it has 
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been proved that children with mental retar- 
dation are interested in technological devic- 
es. (Dempsey, Lucassen, Haynes and Casey, 
2010; Neely, Rispoli, Camargo, Davis and 
Boles, 2013). When we look at studies with 
children with mental disabilities, it is conclud- 
ed that technological devices are very effec- 
tive, especially in the development of academ- 
ic and communication skills or in the teaching 
of new concepts. (Bayram, 2008; Dempsey et. 
al., 2010; Shah, 2011; Compeau and Higgins, 
2011; Cankaya, 2013). 

That is, the use of educational technolo- 
gies in this field has become widespread and 
efficient results have been obtained. it is also 
important that students enjoy the devices or 
teaching materials to obtain fruitful results 
and to learn the skills or concepts success- 
fully. Thus, it is planned to teach concepts to 
students who need special education through 
tablet and tried to reveal the emotions of these 
students during this teaching process. The aim 
of this research is to determine the emotions of 
the students who need special education dur- 
ing the teaching process through Tablet. 


2. MATERIALS AND METHODS 


Document analysis method was used to 
determine the emotions of the students who 
need of special education in the process of 
teaching through tablet. Documents are im- 
portant sources of information that must be 
used effectively in qualitative research. In 
such research, the researcher may obtain the 
data without the need for observations or in- 
terviews. In this sense, document analysis will 
contribute to the researcher in terms of sav- 
ing time and money. Besides written sources, 
visual materials such as film, video and pho- 
tographs. can be used in qualitative research. 
(Yildirim and Simsek, 2013). Document anal- 
ysis is a scientific approach that enables an ob- 
jective and systematic examination of verbal, 
written and other materials. (Tavsancil and 
Aslan, 2001). 

There are several important advantages 
of videos and photos for the researchers. One 
of them; is to present non-verbal behaviors 
such as facial expressions, body movements 
and mimics, in their original form and with 
a certain continuity. Beside this, it allows the 
researchers to watch the same behavior at 
multiple and different intervals. Moreover, it 
allows to determine the events and facts that 
occurs rarely. Finally, these documents can be 
used by other researchers; It might be possible 
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to test the validity of the results of the study 
or or it might be possible to reach some other 
and alternative results (Marshall ve Rossman, 
1999; Yildirim and Simsek, 2013). 

In the descriptive analysis, the obtained 
data are summarized and interpreted accord- 
ing to the previously determined theme. The 
data can be organized according to the theme 
set out by the research questions, or by con- 
sidering the questions or dimensions used in 
the interview and observation processes. In 
descriptive analysis, direct citation is often 
given in order to reflect the views of the inter- 
viewed or observed individuals in a striking 
way. The purpose of such analysis is to pres- 
ent the findings to the reader in an organized 
and interpreted way. The data obtained for this 
purpose is first described systematically and 
explicitly. Later on, descriptions are explained 
and interpreted. Cause and effect relations 
are examined and some results are optained. 
The association of the emerging themes, their 
meaning and their presence for future predic- 
tions can also be among the dimensions of 
the researcher’s interpretation. (Yildirim and 
Simsek, 2013). 

In this research, some themes have been 
set up in order to reveal the emotions in de- 
tail. The documents are analyzed and tabled 
under the theme of anger, disgust, fear, happi- 
ness, neutral, sadness, confusion and hatred. 
After the themes were determined, a total of 
52 teaching sessions were held over a period 
of three months, and videos of students’ work 
using tablets were recorded. Software that is 
used for educational purposes in the process is 
a concept teaching practice in the Google Play 
Store that can be reached through the “Con- 
cept World” key word. 

Five years old,three mentally retarded 
students were involved in the process of us- 
ing the software. Two of the students are girl 
with down syndrome and one is an autistic 
boy. In addition to these three students, two 
special education teachers were included in 
the study. Thus, the opinions of the teachers 
were obtained about teaching process with 
tablet. Participants were selected with appro- 
priate sample method. Students who did not 
know the concepts in the developed software 
and have the ability to learn were selected to 
reach the purpose of the study. 

In the study, students’ responses to the 
material were recorded by the video recorders. 
with the permission of the parents. Thus, all 
students’ behaviors, problems and reactions 
encountered in the teaching process were re- 
corded and analyzed. 


www.ijcrsee.com 


39 


(IJCRSEE) International Journal of Cognitive Research in Science, Engineering and Education 


Vol..3, No. 2, 2017. 


In the study, descriptive analysis method 
of Strauss and Corbin (1998) was used for the 
analysis of data obtained through interviews 
and observation forms. In this analysis, the 
data are summarized and interpreted according 
to the predetermined theme or category. The 
videos were analyzed according to the follow- 
ing themes; Anger, Hate, Disgust, Fear, Hap- 
piness, Natural (Neutral), Sadness and Aston- 
ishment. The reason for choosing these themes 
is that the software used to analyze the photos 
(Microsoft Emotion Detection API) only has 
the ability to analyze these emotions. The fol- 
lowing steps were followed for the analysis of 
the documents; Selecting the sample of analy- 
sis, development of categories, determination 
of analysis unit, quantification and use of data. 

The video recordings of the students 
during the process of the tablet usage was 
stopped when the instructions and reinforce- 
ments were used in the software than screen- 
shots were taken. Laten on, data was analyzed 
using the “Emotion Detection API” from arti- 
ficial intelligence APIs developed by Micro- 
soft as part of the Project Oxford. Thus, stu- 
dents’ emotions in the process of using Tablets 
in their education were analised. The visual- 
ization of the emotion detection API is shown 
in Figure 1. 





Figure 1. Emotion Detection API Anal- 
ysis Screen 


Before pilot applications, teachers were 
informed about the tablet computer, the use of 
the software, the pilot process and important 
points. of As a result ofmeeting, the concept of 
“less” has been determined within the scope of 
the software. 

A total of 52 instructional data were col- 
lected during all the teaching activities. A total 
of 52 videos were watched by researchers and 
special education specialists, and the emotions 
of the students during the activities were de- 
termined. 


3. RESULTS 


As s result of analysis, average of the to- 
tal values was calculated, and it was tried to 
find out what emotions the students were hav- 
ing while using the tablet and concept world 
software. Thus, during the teaching activities 
that teachers have realized, students are ob- 
served how much they are willing and how 
they are using the software as well as their 
emotions are supported by this data. The emo- 
tional analysis that the student is intensely in- 
volved in is stated in the following steps. 





Figure 2. Student 1’s emotional analy- 
sis results. 


As it is seen in Figure 2, when all the 
instructional sessions of Student | are ana- 
lyzed, as a result of emotion analysis, it can be 
said that student is “happy” when he use the 
concept world software and enjoy the lesson 
during the process.(happiness=0.99997). It is 
seen that student | is happy and entertained in 
the process of teaching with tablet, and it has 
also great influence on learning the concepts 
faster. Moreover, Student 1’s positive attitude 
in the lecture process have been supported by 
teacher opinion. Teacher’s opinion on this sit- 
uation: 

“Student I is enjoying using a tablet. 
I used to predict even before using this soft- 
ware, it could be effective.. Because Students 1 
always spent time using hi own tablet outside 
the school. He is never get bored. I think it was 
a pleasant process for student 1. “ 


When the emotional analysis results of 
Student 2 are examined, although the student 
displayed an average of “neutral” (neutral = 
0.04472) gesture in the process of initial use 
of the software, in the later process (Fig.4), 
there is an increase in “happiness” emotion 
(happiness = 0.95142). in addition to these, 
it was observed in the beginning that the re- 
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sponse to the software was not only natural fa- 
cial expression but also in the average sense of 
“surprise” (surprise = 0.00224). 
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Figure 3. Student 2’s emotional analysis 
results. 


But, in general terms, the averages of 
the analysis have shown that student 2 was 
happy in the process of using the concept 
world software. Teacher | explained this re- 
sult as students 2 had adaptation problem in 
the beginning since she did not use Tablet be- 
fore. Teacher’s opinion on this situation 

“Student 2 is not normally a very laugh- 
ing and excited student. Sometimes it can 
be very difficult to make her laugh. Initially, 
she exhibited the same timid behaviors while 
teaching with tablets as she did it with using 
new teaching and learning materials before. 
But as it seen from the videos, she adapted 
very quickly and after three or five sessions we 
had fun and enjoyed the lessons. Sometimes, 
she even responded to the directions taken 
from the Tablet. Normally, she does not prefer 
to talk.” 
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Figure 4. Student 2’s emotional analysis 
results. 
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Student 3 sometimes tended to talk 
with the guidelines in the software during the 
teaching process with the concept world soft- 
ware and asked the teacher to reinforce the 
guidelines given by touching the tablets as 
well as her own answers. Generaly, it can be 
said that during this process, student 3 learned 
and enjoyed learning with Tablet. Emotional 
analysis also supports this situation. Student 
3’s teacher stated about this situation as: 

“She is the most cheerful students in the 
school. As soon as she comes to the school, 
she salutes everyone, and also has a diffent 
energy to attract everyone's attention. This 
energy also reflects her lessons however, her 
attention is distracted in a short time in the 
class. While using tablet we have not had any 
attention problem. As it is seen in videos, she 
was constantly interacting with the characters 
and directives in the Tablet and was always 
talking during the teaching process. I think 
this is another important effect of Tablet using 
except teaching the concepts effectively. That 
is Tablet using increase the attention of the 
student during the lessons.” Figure 5 shows 
the happiness of Student 3 during the teaching 
session. 
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Figure 5. Student 3’s emotional analysis 
results. 


According to the analysis, it can be said 
that student is “happy” when she use the con- 
cept world software and enjoy the lesson dur- 
ing the teaching process(happiness=0.99976). 


4. DISCUSSION 


According to the results of the artificial 
intelligence emotions analysis, it is seen that 
the students are happy and eager to learn in 
the process of teaching with tablet. Another 
common point is that they are a bit confused 
sometimes, although they are eager in the ini- 
tial teaching sessions. As a result, it can be 
said that the positive results of the emotional 
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analysis and positive results obtained from the 
teaching sessions with the tablet support each 
other. 

Students’ willingness and pleasure dur- 
ing the teaching and learning process reflect 
on their success positively. 

As it is seen in the results of the emo- 
tional analysis conducted during the teaching 
process, it is observed that students are con- 
fused in the begining then they adapt to the 
tablet usage in education in a short time, and 
this application make them happy. Thus, it can 
be said that education with Tablet increases the 
communication skills of students with mental 
disabilities also affect the motivation and at- 
titutudes towards this kind of teaching tools 
positively. There is an important connection 
between students’ satisfaction and materials 
used during teaching process. Effectiveness of 
this situation on students’ success is supported 
by researches. 

In the literature, there are studies about 
students’ motivation and attitudes towards tab- 
let however all the data has been collected only 
with teachers’ opinions. (Arpacik, Kursun and 
Goktas, 2013; Soykan and Ozdamli, 2016). 
In this study, emotional analysis has been 
conducted to increase the reality to make the 
situation more realistic. When student enjoys 
his performance during the study, happiness 
appears automatically. Appreciated students 
performs better performance in every aspect 
of life than the students not having any appre- 
tiation. The reason of this situation can said 
as enjoyment of the acted performans. (Oztiirk 
and Diindar, 2003). 

The features that distinguish human be- 
ings from other creatures are their emotions. 
Emotion is an affective state of consciousness 
in which joy, sorrow, fear, hate, or the like, is 
experienced, as distinguished from cognitive 
and volitional states of consciousness (Titrek, 
2013). One can experience a single feeling of 
happiness, happiness, sadness, or very sad- 
ness at different intensities while experienc- 
ing different feelings such as happiness, joy, 
sadness, grief, anger, enthusiasm, and fear. In 
fact, there are two basic feelings in people as 
mainly positive and negative. while positive 
feelings are promoting and sustaining people’s 
life, negative feelings threaten and cause in- 
tellectual and physical harms (Karabekiroglu, 
2014; Uskan, 2014). 

In particular, the negative emotional ex- 
periences can lead to the loss of the interest, 
the feeling of worthlessness, anxiety, unhap- 
piness, embarrassment, irritability, anger and 
anger as well as being easily tired and slowed 


down in their movements. It also can cause dif- 
ficulties in making decisions, feeling less en- 
ergetic and powerless. (Uskan, 2014; Duygu 
Durum Bozukluklari, 2009). According to re- 
sults of this study, having positive emotions 
of sudents during teaching process teaching 
process they have been using on their tablet 
computers, showing that the material used can 
be more effective and motivating. Like other 
technological devices, tablet has been shown 
to be effective in the education of individuals 
who need special education, but there have 
been no studies showing how students are 
emotionally involved in the use of these de- 
vices. From this point of view, it can be said 
that the teaching activities with these devices 
can have a positive effect on the students’ both 
achievement and motivation.Moreover, the re- 
sults of the study put forward that the number 
of educational software developed for use in 
tablet cis inadequate in our country, it takes 
the necessary steps in terms of tablet comput- 
er-assisted education in which such positive 
results are obtained and suggests to design 
various teaching environments. 


5. CONCLUSION 


In this study, the process has been only 
performed with the specified software. In the 
new researches, it is important to put forward 
the emotional analysis and motivation of stu- 
dents as well as their success with different 
educational softwares which are also impor- 
tant in terms of using technology in the field 
of special education. Thus, this shows how 
much fun and enthusiasm students have when 
using these devices, and the studies to be done 
in this direction can be enhanced. The best in- 
dicator of happiness being a positive feeling is 
smile. Happiness can be observed from mouth 
and eye area as a facial expression. Happiness 
does not cause significant changes in brow and 
forehead area. Happy people are more cau- 
tious and have a better ability to concentrate. 
(Konrad ve Hendl, 2001; Schober, 1999). Ac- 
cording to analysis results, it has been seen 
that the students are happy in the teaching 
process with tablet. 

Sadness is an emotional state that causes 
severe depression in the individual when suf- 
fering grief, cheerlessness, gloom, melancholy, 
self-pity, loneliness, boredom, hopelessness 
and pathology. Sadness makes energy lower 
in the individual, slows down metabolism as it 
gets deeper and closer to depression, causing 
it to drift away from things that are enjoyed in 
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life. (Goleman, 2005). Symptoms of sadness 
are fatigue, loss of appetite, insomnia, and 
inability to concentrate. (Konrad ve Hendl, 
2001; Schober, 1999). It is obvious what are 
the negative consequences of the students be- 
ing sad in the process and how badly they can 
be affected both in terms of achievement and 
motivation. As s result, students’ happiness 
and positive fellings during the process of us- 
ing tablet computers in education demonstrate 
the necessity of increasing the educational use 
of this kind of tools. 
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